Collin County RE Data Analysis

Dataset statistics

Number of variables	39
Number of observations	135489
Missing cells	439255
Missing cells (%)	8.3%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	40.3 MiB
Average record size in memory	312.0 B

Variable types

CAT	20
NUM	18
BOOL	1

Reproduction

Analysis started	2020-05-23 04:46:24.703232
Analysis finished	2020-05-23 04:51:27.726078
Duration	5 minutes and 3.02 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`CloseDate` has a high cardinality: 5066 distinct values	High cardinality
`ElementarySchoolName` has a high cardinality: 184 distinct values	High cardinality
`HighSchoolName` has a high cardinality: 79 distinct values	High cardinality
`MiddleSchoolName` has a high cardinality: 89 distinct values	High cardinality
`StreetName` has a high cardinality: 15170 distinct values	High cardinality
`StreetNumber` has a high cardinality: 10358 distinct values	High cardinality
`ArchitecturalStyle` has a high cardinality: 264 distinct values	High cardinality
`TaxLegalDescription` has a high cardinality: 61974 distinct values	High cardinality
`CurrentPrice` is highly correlated with `ClosePrice` and 1 other fields	High correlation
`ClosePrice` is highly correlated with `CurrentPrice` and 1 other fields	High correlation
`ListPrice` is highly correlated with `ClosePrice` and 1 other fields	High correlation
`City` is highly correlated with `PostalCode`	High correlation
`PostalCode` is highly correlated with `City`	High correlation
`SchoolDistrict` is highly correlated with `HighSchoolName` and 2 other fields	High correlation
`HighSchoolName` is highly correlated with `SchoolDistrict`	High correlation
`MiddleSchoolName` is highly correlated with `SchoolDistrict`	High correlation
`SeniorHighSchoolName` is highly correlated with `SchoolDistrict`	High correlation
`StreetDirSuffix` is highly correlated with `StreetDirPrefix`	High correlation
`StreetDirPrefix` is highly correlated with `StreetDirSuffix`	High correlation
`HighSchoolName` has 1548 (1.1%) missing values	Missing
`Occupancy` has 24987 (18.4%) missing values	Missing
`SchoolDistrict` has 7915 (5.8%) missing values	Missing
`SeniorHighSchoolName` has 85203 (62.9%) missing values	Missing
`StreetDirPrefix` has 132091 (97.5%) missing values	Missing
`StreetDirSuffix` has 135005 (99.6%) missing values	Missing
`StreetSuffix` has 13679 (10.1%) missing values	Missing
`ArchitecturalStyle` has 10981 (8.1%) missing values	Missing
`TaxLegalDescription` has 25836 (19.1%) missing values	Missing
`OriginalListPrice` is highly skewed (γ1 = 241.5921536)	Skewed
`RATIO_ClosePrice_By_ListPrice` is highly skewed (γ1 = 368.085808)	Skewed
`RATIO_ClosePrice_By_OriginalListPrice` is highly skewed (γ1 = 141.6519951)	Skewed
`RATIO_CurrentPrice_By_SQFT` is highly skewed (γ1 = 89.49316584)	Skewed
`YearBuilt` is highly skewed (γ1 = 97.23247123)	Skewed
`df_index` has unique values	Unique
`DOM` has 1820 (1.3%) zeros	Zeros
`ParkingSpacesGarage` has 4197 (3.1%) zeros	Zeros

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct count	135489
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	107959.31885245297
Minimum	0
Maximum	213410
Zeros	1
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	11374.4
Q1	54955
median	108487
Q3	161734
95-th percentile	203277.6
Maximum	213410
Range	213410
Interquartile range (IQR)	106779

Descriptive statistics

Standard deviation	61375.38889
Coefficient of variation (CV)	0.5685047807
Kurtosis	-1.196706121
Mean	107959.3189
Median Absolute Deviation (MAD)	53383
Skewness	-0.02476599036
Sum	1.462730015e+10
Variance	3766938361

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
8188	1	< 0.1%
136168	1	< 0.1%
54192	1	< 0.1%
56241	1	< 0.1%
52147	1	< 0.1%
39865	1	< 0.1%
33722	1	< 0.1%
48061	1	< 0.1%
203721	1	< 0.1%
197578	1	< 0.1%
Other values (135479)	135479	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
7	1	< 0.1%

Value	Count	Frequency (%)
213410	1	< 0.1%
213409	1	< 0.1%
213408	1	< 0.1%
213405	1	< 0.1%
213404	1	< 0.1%

PostalCode
Categorical

HIGH CORRELATION

Distinct count	23
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

75070	27557
75035	16773
75025	13269
75023	12396
75071	11850
Other values (18)	53644

Common Values
Length

Value	Count	Frequency (%)
75070	27557	20.3%
75035	16773	12.4%
75025	13269	9.8%
75023	12396	9.1%
75071	11850	8.7%
75093	11348	8.4%
75074	8464	6.2%
75075	8276	6.1%
75069	6638	4.9%
75024	6558	4.8%
Other values (13)	12360	9.1%

Length

Max length	5
Median length	5
Mean length	5
Min length	5

BathsTotal
Real number (ℝ_≥0)

Distinct count	47
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.5546000044284036
Minimum	0.0
Maximum	9.3
Zeros	24
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	2
median	2.1
Q3	3.1
95-th percentile	4.1
Maximum	9.3
Range	9.3
Interquartile range (IQR)	1.1

Descriptive statistics

Standard deviation	0.8042789529
Coefficient of variation (CV)	0.3148355717
Kurtosis	1.973783054
Mean	2.554600004
Median Absolute Deviation (MAD)	0.1
Skewness	1.206619227
Sum	346120.2
Variance	0.6468646341

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	49422	36.5%
2.1	29258	21.6%
3.1	18368	13.6%
3	17935	13.2%
4	8064	6.0%
4.1	5271	3.9%
1	1715	1.3%
1.1	1467	1.1%
5.1	991	0.7%
3.2	684	0.5%
Other values (37)	2314	1.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	24	< 0.1%
0.1	2	< 0.1%
0.2	4	< 0.1%
1	1715	1.3%
1.1	1467	1.1%

Value	Count	Frequency (%)
9.3	2	< 0.1%
9.2	1	< 0.1%
8.4	1	< 0.1%
8.3	1	< 0.1%
8.2	1	< 0.1%

BedsTotal
Real number (ℝ_≥0)

Distinct count	11
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.681221353763036
Minimum	0.0
Maximum	42.0
Zeros	26
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	3
median	4
Q3	4
95-th percentile	5
Maximum	42
Range	42
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7923628337
Coefficient of variation (CV)	0.21524455
Kurtosis	80.84733718
Mean	3.681221354
Median Absolute Deviation (MAD)	1
Skewness	1.740453791
Sum	498765
Variance	0.6278388602

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4	62223	45.9%
3	49941	36.9%
5	16615	12.3%
2	5369	4.0%
6	889	0.7%
1	361	0.3%
7	49	< 0.1%
0	26	< 0.1%
8	11	< 0.1%
9	3	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	26	< 0.1%
1	361	0.3%
2	5369	4.0%
3	49941	36.9%
4	62223	45.9%

Value	Count	Frequency (%)
42	2	< 0.1%
9	3	< 0.1%
8	11	< 0.1%
7	49	< 0.1%
6	889	0.7%

City
Categorical

HIGH CORRELATION

Distinct count	5
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

Plano	60769
McKinney	45033
Frisco	23784
Prosper	3373
Fairview	2530

Common Values
Length

Value	Count	Frequency (%)
Plano	60769	44.9%
McKinney	45033	33.2%
Frisco	23784	17.6%
Prosper	3373	2.5%
Fairview	2530	1.9%

Length

Max length	8
Median length	6
Mean length	6.278472791
Min length	5

CloseDate
Categorical

HIGH CARDINALITY

Distinct count	5066
Unique (%)	3.7%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

4/29/2005	176
4/28/2005	160
8/28/2009	158
2/27/2015	150
4/30/2009	148
Other values (5061)	134697

Common Values
Length

Value	Count	Frequency (%)
4/29/2005	176	0.1%
4/28/2005	160	0.1%
8/28/2009	158	0.1%
2/27/2015	150	0.1%
4/30/2009	148	0.1%
6/30/2005	144	0.1%
3/31/2005	138	0.1%
6/26/2009	128	0.1%
4/15/2005	128	0.1%
5/29/2009	128	0.1%
Other values (5056)	134031	98.9%

Length

Max length	10
Median length	9
Mean length	8.991681982
Min length	8

ClosePrice
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10003
Unique (%)	7.4%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	282178.02747667686
Minimum	70.0
Maximum	6547500.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	70
5-th percentile	118800
Q1	171000
median	240000
Q3	331000
95-th percentile	579900
Maximum	6547500
Range	6547430
Interquartile range (IQR)	160000

Descriptive statistics

Standard deviation	192518.9748
Coefficient of variation (CV)	0.6822606866
Kurtosis	57.26893825
Mean	282178.0275
Median Absolute Deviation (MAD)	75100
Skewness	5.023720581
Sum	3.823173659e+10
Variance	3.706355565e+10

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
250000	1096	0.8%
225000	976	0.7%
275000	934	0.7%
300000	883	0.7%
165000	868	0.6%
265000	857	0.6%
210000	854	0.6%
260000	852	0.6%
215000	846	0.6%
175000	845	0.6%
Other values (9993)	126477	93.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
70	1	< 0.1%
81	1	< 0.1%
110	1	< 0.1%
165	1	< 0.1%
220	1	< 0.1%

Value	Count	Frequency (%)
6547500	1	< 0.1%
5720000	1	< 0.1%
5150000	1	< 0.1%
4900000	1	< 0.1%
4275000	1	< 0.1%

CurrentPrice
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10003
Unique (%)	7.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	282184.7647171357
Minimum	70.0
Maximum	6547500.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	70
5-th percentile	118800
Q1	171000
median	240000
Q3	331000
95-th percentile	579900
Maximum	6547500
Range	6547430
Interquartile range (IQR)	160000

Descriptive statistics

Standard deviation	192534.2359
Coefficient of variation (CV)	0.6822984795
Kurtosis	57.25241326
Mean	282184.7647
Median Absolute Deviation (MAD)	75100
Skewness	5.023170593
Sum	3.823293159e+10
Variance	3.706943199e+10

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
250000	1096	0.8%
225000	976	0.7%
275000	934	0.7%
300000	883	0.7%
165000	868	0.6%
265000	857	0.6%
210000	854	0.6%
260000	852	0.6%
215000	846	0.6%
175000	845	0.6%
Other values (9993)	126478	93.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
70	1	< 0.1%
81	1	< 0.1%
110	1	< 0.1%
165	1	< 0.1%
220	1	< 0.1%

Value	Count	Frequency (%)
6547500	1	< 0.1%
5720000	1	< 0.1%
5150000	1	< 0.1%
4900000	1	< 0.1%
4275000	1	< 0.1%

DOM
Real number (ℝ)

ZEROS

Distinct count	610
Unique (%)	0.5%
Missing	23
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	48.92087313421818
Minimum	-97.0
Maximum	1649.0
Zeros	1820
Zeros (%)	1.3%
Memory size	1.0 MiB

Quantile statistics

Minimum	-97
5-th percentile	2
Q1	9
median	28
Q3	67
95-th percentile	163
Maximum	1649
Range	1746
Interquartile range (IQR)	58

Descriptive statistics

Standard deviation	60.37500673
Coefficient of variation (CV)	1.234135919
Kurtosis	25.03125538
Mean	48.92087313
Median Absolute Deviation (MAD)	22
Skewness	3.255511113
Sum	6627115
Variance	3645.141438

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
3	5303	3.9%
4	5078	3.7%
5	4353	3.2%
2	3903	2.9%
6	3510	2.6%
7	3245	2.4%
10	2780	2.1%
8	2719	2.0%
11	2451	1.8%
9	2389	1.8%
Other values (600)	99735	73.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-97	1	< 0.1%
-67	1	< 0.1%
-58	1	< 0.1%
-41	2	< 0.1%
-39	1	< 0.1%

Value	Count	Frequency (%)
1649	2	< 0.1%
1324	1	< 0.1%
1243	1	< 0.1%
1091	1	< 0.1%
1066	1	< 0.1%

ElementarySchoolName
Categorical

HIGH CARDINALITY

Distinct count	184
Unique (%)	0.1%
Missing	219
Missing (%)	0.2%
Memory size	1.0 MiB

Christie	5274
Thomas	2856
Glenoaks	2734
Johnson	2724
Curtsinger	2553
Other values (179)	119129

Common Values
Length

Value	Count	Frequency (%)
Christie	5274	3.9%
Thomas	2856	2.1%
Glenoaks	2734	2.0%
Johnson	2724	2.0%
Curtsinger	2553	1.9%
Gunstream	2517	1.9%
Bennett	2485	1.8%
Shawnee	2397	1.8%
Wolford	2311	1.7%
Spears	2304	1.7%
Other values (174)	107115	79.1%

Length

Max length	27
Median length	7
Mean length	7.606477279
Min length	3

HighSchoolName
Categorical

HIGH CARDINALITY
HIGH CORRELATION
MISSING

Distinct count	79
Unique (%)	0.1%
Missing	1548
Missing (%)	1.1%
Memory size	1.0 MiB

Mckinney	14013
Jasper	13080
Clark	12386
Centennial	11932
Vines	11139
Other values (74)	71391

Common Values
Length

Value	Count	Frequency (%)
Mckinney	14013	10.3%
Jasper	13080	9.7%
Clark	12386	9.1%
Centennial	11932	8.8%
Vines	11139	8.2%
Mckinney Boyd	10803	8.0%
Shepton	8553	6.3%
Frisco	8428	6.2%
Mckinneyno	8320	6.1%
Williams	7305	5.4%
Other values (69)	27982	20.7%

Length

Max length	23
Median length	7
Mean length	7.67602536
Min length	3

AssociationType
Categorical

Distinct count	3
Unique (%)	< 0.1%
Missing	2
Missing (%)	< 0.1%
Memory size	1.0 MiB

Mandatory	86663
None	41007
Voluntary	7817

Common Values
Length

Value	Count	Frequency (%)
Mandatory	86663	64.0%
None	41007	30.3%
Voluntary	7817	5.8%
(Missing)	2	< 0.1%

Length

Max length	9
Median length	9
Mean length	7.48661515
Min length	3

ListPrice
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	6110
Unique (%)	4.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	288190.4165578017
Minimum	1.0
Maximum	6750000.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	1
5-th percentile	120000
Q1	174900
median	244500
Q3	339000
95-th percentile	598000
Maximum	6750000
Range	6749999
Interquartile range (IQR)	164100

Descriptive statistics

Standard deviation	203813.1287
Coefficient of variation (CV)	0.7072168852
Kurtosis	69.71709055
Mean	288190.4166
Median Absolute Deviation (MAD)	77000
Skewness	5.561089978
Sum	3.904663135e+10
Variance	4.153979145e+10

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
169900	1657	1.2%
179900	1492	1.1%
159900	1491	1.1%
199900	1459	1.1%
249900	1437	1.1%
189900	1372	1.0%
149900	1319	1.0%
299900	1259	0.9%
139900	1184	0.9%
225000	1179	0.9%
Other values (6100)	121640	89.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
1995	1	< 0.1%
9900	1	< 0.1%
13200	2	< 0.1%
13500	1	< 0.1%

Value	Count	Frequency (%)
6750000	1	< 0.1%
6399000	2	< 0.1%
5400000	1	< 0.1%
5150000	1	< 0.1%
4900000	2	< 0.1%

LotSize
Categorical

Distinct count	10
Unique (%)	< 0.1%
Missing	14
Missing (%)	< 0.1%
Memory size	1.0 MiB

Less Than .5 Acre (not Zero)	119777
.5 Acre to .99 Acre	6378
Condo/Townhome Lot	3395
Zero Lot	2761
1 Acre to 2.99 Acres	2548
Other values (5)	616

Common Values
Length

Value	Count	Frequency (%)
Less Than .5 Acre (not Zero)	119777	88.4%
.5 Acre to .99 Acre	6378	4.7%
Condo/Townhome Lot	3395	2.5%
Zero Lot	2761	2.0%
1 Acre to 2.99 Acres	2548	1.9%
3 Acres to 4.99 Acres	315	0.2%
5 Acres to 9.99 Acres	162	0.1%
10 Acres to 49.99 Acres	128	0.1%
Over 100 Acres	9	< 0.1%
50 Acres to 100 Acres	2	< 0.1%
(Missing)	14	< 0.1%

Length

Max length	28
Median length	28
Mean length	26.73476814
Min length	3

MiddleSchoolName
Categorical

HIGH CARDINALITY
HIGH CORRELATION

Distinct count	89
Unique (%)	0.1%
Missing	700
Missing (%)	0.5%
Memory size	1.0 MiB

Dowell	8747
Evans	7438
Carpenter	7292
Faubion	7181
Renner	6675
Other values (84)	97456

Common Values
Length

Value	Count	Frequency (%)
Dowell	8747	6.5%
Evans	7438	5.5%
Carpenter	7292	5.4%
Faubion	7181	5.3%
Renner	6675	4.9%
Wester	6661	4.9%
Clark	6628	4.9%
Haggard	6323	4.7%
Roach	5873	4.3%
Robinson	5308	3.9%
Other values (79)	66663	49.2%

Length

Max length	23
Median length	6
Mean length	7.01513776
Min length	3

MLSNumber
Real number (ℝ_≥0)

Distinct count	125047
Unique (%)	92.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	11898237.272088509
Minimum	9308485.0
Maximum	14320678.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	9308485
5-th percentile	9715248.2
Q1	10759410
median	11712748
Q3	13278224
95-th percentile	14048282.8
Maximum	14320678
Range	5012193
Interquartile range (IQR)	2518814

Descriptive statistics

Standard deviation	1378898.113
Coefficient of variation (CV)	0.1158909577
Kurtosis	-1.248301438
Mean	11898237.27
Median Absolute Deviation (MAD)	1310408
Skewness	0.146516078
Sum	1.61208027e+12
Variance	1.901360005e+12

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
10222915	3	< 0.1%
10262888	3	< 0.1%
10253334	3	< 0.1%
10220291	3	< 0.1%
10214609	3	< 0.1%
10214578	3	< 0.1%
10258738	3	< 0.1%
10216645	3	< 0.1%
10237578	3	< 0.1%
10249594	3	< 0.1%
Other values (125037)	135459	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
9308485	1	< 0.1%
9325434	1	< 0.1%
9326879	1	< 0.1%
9377660	1	< 0.1%
9388582	1	< 0.1%

Value	Count	Frequency (%)
14320678	1	< 0.1%
14320220	1	< 0.1%
14313727	1	< 0.1%
14311113	1	< 0.1%
14311028	1	< 0.1%

NumberOfDiningAreas
Real number (ℝ_≥0)

Distinct count	8
Unique (%)	< 0.1%
Missing	2
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	1.7552975562231063
Minimum	0.0
Maximum	9.0
Zeros	724
Zeros (%)	0.5%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	2
median	2
Q3	2
95-th percentile	2
Maximum	9
Range	9
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.4500100065
Coefficient of variation (CV)	0.2563724907
Kurtosis	1.263202183
Mean	1.755297556
Median Absolute Deviation (MAD)	0
Skewness	-1.181274207
Sum	237820
Variance	0.2025090059

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	102294	75.5%
1	32108	23.7%
0	724	0.5%
3	335	0.2%
4	19	< 0.1%
5	4	< 0.1%
7	2	< 0.1%
9	1	< 0.1%
(Missing)	2	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	724	0.5%
1	32108	23.7%
2	102294	75.5%
3	335	0.2%
4	19	< 0.1%

Value	Count	Frequency (%)
9	1	< 0.1%
7	2	< 0.1%
5	4	< 0.1%
4	19	< 0.1%
3	335	0.2%

NumberOfLivingAreas
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	2.0672015233821446
Minimum	0.0
Maximum	9.0
Zeros	68
Zeros (%)	0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	9
Range	9
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	0.9108283203
Coefficient of variation (CV)	0.4406093504
Kurtosis	1.018902865
Mean	2.067201523
Median Absolute Deviation (MAD)	1
Skewness	0.7455344679
Sum	280081
Variance	0.8296082291

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	56073	41.4%
1	39847	29.4%
3	31644	23.4%
4	6523	4.8%
5	1061	0.8%
6	189	0.1%
0	68	0.1%
7	52	< 0.1%
8	18	< 0.1%
9	13	< 0.1%
(Missing)	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	68	0.1%
1	39847	29.4%
2	56073	41.4%
3	31644	23.4%
4	6523	4.8%

Value	Count	Frequency (%)
9	13	< 0.1%
8	18	< 0.1%
7	52	< 0.1%
6	189	0.1%
5	1061	0.8%

NumberOfStories
Real number (ℝ_≥0)

Distinct count	6
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.5312534596904546
Minimum	0.0
Maximum	5.0
Zeros	260
Zeros (%)	0.2%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	1
median	2
Q3	2
95-th percentile	2
Maximum	5
Range	5
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.5119606511
Coefficient of variation (CV)	0.3343408943
Kurtosis	-1.553155593
Mean	1.53125346
Median Absolute Deviation (MAD)	0
Skewness	-0.05682599414
Sum	207468
Variance	0.2621037083

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	71047	52.4%
1	63595	46.9%
3	572	0.4%
0	260	0.2%
4	12	< 0.1%
5	3	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	260	0.2%
1	63595	46.9%
2	71047	52.4%
3	572	0.4%
4	12	< 0.1%

Value	Count	Frequency (%)
5	3	< 0.1%
4	12	< 0.1%
3	572	0.4%
2	71047	52.4%
1	63595	46.9%

Occupancy
Categorical

MISSING

Distinct count	3
Unique (%)	< 0.1%
Missing	24987
Missing (%)	18.4%
Memory size	1.0 MiB

Owner	74955
Vacant	32541
Tenant	3006

Common Values
Length

Value	Count	Frequency (%)
Owner	74955	55.3%
Vacant	32541	24.0%
Tenant	3006	2.2%
(Missing)	24987	18.4%

Length

Max length	6
Median length	5
Mean length	4.893519031
Min length	3

OriginalListPrice
Real number (ℝ_≥0)

SKEWED

Distinct count	6113
Unique (%)	4.5%
Missing	6
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	302765.87255227595
Minimum	0.0
Maximum	430000000.0
Zeros	18
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	124000
Q1	175140.5
median	248500
Q3	345000
95-th percentile	612900
Maximum	430000000
Range	430000000
Interquartile range (IQR)	169859.5

Descriptive statistics

Standard deviation	1490388.528
Coefficient of variation (CV)	4.922577686
Kurtosis	63436.34791
Mean	302765.8726
Median Absolute Deviation (MAD)	78600
Skewness	241.5921536
Sum	4.101962871e+10
Variance	2.221257965e+12

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
169900	1532	1.1%
179900	1453	1.1%
249900	1364	1.0%
159900	1344	1.0%
189900	1326	1.0%
199900	1324	1.0%
299900	1196	0.9%
149900	1192	0.9%
225000	1177	0.9%
275000	1113	0.8%
Other values (6103)	122462	90.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	18	< 0.1%
1	10	< 0.1%
320	1	< 0.1%
1000	3	< 0.1%
1990	1	< 0.1%

Value	Count	Frequency (%)
430000000	1	< 0.1%
299900900	1	< 0.1%
126500000	1	< 0.1%
34990000	1	< 0.1%
27990000	2	< 0.1%

ParkingSpacesGarage
Real number (ℝ_≥0)

ZEROS

Distinct count	10
Unique (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	2.1219443788379784
Minimum	0.0
Maximum	9.0
Zeros	4197
Zeros (%)	3.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	2
median	2
Q3	2
95-th percentile	3
Maximum	9
Range	9
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.6100273583
Coefficient of variation (CV)	0.2874850842
Kurtosis	8.5408728
Mean	2.121944379
Median Absolute Deviation (MAD)	0
Skewness	-0.00398990481
Sum	287498
Variance	0.3721333779

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	103420	76.3%
3	24009	17.7%
0	4197	3.1%
1	2454	1.8%
4	1106	0.8%
5	161	0.1%
6	89	0.1%
7	20	< 0.1%
9	18	< 0.1%
8	14	< 0.1%
(Missing)	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4197	3.1%
1	2454	1.8%
2	103420	76.3%
3	24009	17.7%
4	1106	0.8%

Value	Count	Frequency (%)
9	18	< 0.1%
8	14	< 0.1%
7	20	< 0.1%
6	89	0.1%
5	161	0.1%

PoolYN
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	1.0 MiB

False	102465
True	33023
(Missing)	1

Frequency Table

Value	Count	Frequency (%)
False	102465	75.6%
True	33023	24.4%
(Missing)	1	< 0.1%

PropertySubType
Categorical

Distinct count	5
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

RES-Single Family	128567
RES-Townhouse	4256
RES-Condo	1692
RES-Half Duplex	913
RES-Farm/Ranch	61

Common Values
Length

Value	Count	Frequency (%)
RES-Single Family	128567	94.9%
RES-Townhouse	4256	3.1%
RES-Condo	1692	1.2%
RES-Half Duplex	913	0.7%
RES-Farm/Ranch	61	< 0.1%

Length

Max length	17
Median length	17
Mean length	16.75961886
Min length	9

RATIO_ClosePrice_By_ListPrice
Real number (ℝ_≥0)

SKEWED

Distinct count	15560
Unique (%)	11.5%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	1.7592589004930324
Minimum	0.0005200000000000001
Maximum	105000.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	0.00052
5-th percentile	0.9256435
Q1	0.96677
median	0.98511
Q3	1
95-th percentile	1.03563
Maximum	105000
Range	104999.9995
Interquartile range (IQR)	0.03323

Descriptive statistics

Standard deviation	285.25631
Coefficient of variation (CV)	162.1457251
Kurtosis	135487.4408
Mean	1.7592589
Median Absolute Deviation (MAD)	0.01498
Skewness	368.085808
Sum	238358.4699
Variance	81371.16239

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	19071	14.1%
0.98039	312	0.2%
0.96	308	0.2%
0.97143	292	0.2%
0.97561	276	0.2%
0.95238	275	0.2%
0.97778	273	0.2%
0.96667	265	0.2%
0.96774	263	0.2%
0.98	247	0.2%
Other values (15550)	113906	84.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.00052	1	< 0.1%
0.00054	1	< 0.1%
0.00095	1	< 0.1%
0.00096	1	< 0.1%
0.00097	1	< 0.1%

Value	Count	Frequency (%)
105000	1	< 0.1%
150.37594	1	< 0.1%
10	1	< 0.1%
9.47867	1	< 0.1%
7.54717	1	< 0.1%

RATIO_ClosePrice_By_OriginalListPrice
Real number (ℝ_≥0)

SKEWED

Distinct count	20711
Unique (%)	15.3%
Missing	25
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	15.76715562452017
Minimum	0.0005099999999999999
Maximum	378000.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	0.00051
5-th percentile	0.866329
Q1	0.94279
median	0.97398
Q3	1
95-th percentile	1.035177
Maximum	378000
Range	377999.9995
Interquartile range (IQR)	0.05721

Descriptive statistics

Standard deviation	1839.114122
Coefficient of variation (CV)	116.6420987
Kurtosis	22425.93246
Mean	15.76715562
Median Absolute Deviation (MAD)	0.02602
Skewness	141.6519951
Sum	2135881.97
Variance	3382340.754

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	13474	9.9%
0.95238	298	0.2%
0.96	288	0.2%
0.97143	248	0.2%
0.96667	236	0.2%
0.93333	233	0.2%
0.95	230	0.2%
0.96774	226	0.2%
0.90909	215	0.2%
0.98039	211	0.2%
Other values (20701)	119805	88.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.00051	1	< 0.1%
0.00052	1	< 0.1%
0.00092	1	< 0.1%
0.00093	1	< 0.1%
0.00094	1	< 0.1%

Value	Count	Frequency (%)
378000	1	< 0.1%
276000	1	< 0.1%
225000	1	< 0.1%
222500	1	< 0.1%
187500	1	< 0.1%

RATIO_CurrentPrice_By_SQFT
Real number (ℝ_≥0)

SKEWED

Distinct count	15776
Unique (%)	11.6%
Missing	36
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	104.63622850730512
Minimum	0.03
Maximum	10000.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.0 MiB

Quantile statistics

Minimum	0.03
5-th percentile	64.26
Q1	80.57
median	96.74
Q3	124.05
95-th percentile	164.05
Maximum	10000
Range	9999.97
Interquartile range (IQR)	43.48

Descriptive statistics

Standard deviation	43.2295142
Coefficient of variation (CV)	0.413140982
Kurtosis	20275.61731
Mean	104.6362285
Median Absolute Deviation (MAD)	19.71
Skewness	89.49316584
Sum	14173291.06
Variance	1868.790898

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
83.33	86	0.1%
100	85	0.1%
125	63	< 0.1%
90.91	60	< 0.1%
111.11	48	< 0.1%
83.29	47	< 0.1%
85.71	45	< 0.1%
76.92	44	< 0.1%
96.15	44	< 0.1%
92.59	43	< 0.1%
Other values (15766)	134888	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.03	1	< 0.1%
0.04	1	< 0.1%
0.07	1	< 0.1%
0.08	2	< 0.1%
0.1	1	< 0.1%

Value	Count	Frequency (%)
10000	1	< 0.1%
1217.73	1	< 0.1%
1000	1	< 0.1%
865.38	1	< 0.1%
779.9	1	< 0.1%

SchoolDistrict
Categorical

HIGH CORRELATION
MISSING

Distinct count	13
Unique (%)	< 0.1%
Missing	7915
Missing (%)	5.8%
Memory size	1.0 MiB

Plano ISD	50439
Frisco ISD	35479
McKinney ISD	31829
Prosper ISD	6701
Lovejoy ISD	1835
Other values (8)	1291

Common Values
Length

Value	Count	Frequency (%)
Plano ISD	50439	37.2%
Frisco ISD	35479	26.2%
McKinney ISD	31829	23.5%
Prosper ISD	6701	4.9%
Lovejoy ISD	1835	1.4%
Allen ISD	762	0.6%
Lewisville ISD	302	0.2%
Melissa ISD	140	0.1%
Princeton ISD	47	< 0.1%
Celina ISD	33	< 0.1%
Other values (3)	7	< 0.1%
(Missing)	7915	5.8%

Length

Max length	14
Median length	10
Mean length	9.757146337
Min length	3

SellerType
Categorical

Distinct count	2
Unique (%)	< 0.1%
Missing	978
Missing (%)	0.7%
Memory size	1.0 MiB

Individual(s)	125131
Lender/REO	9380

Common Values
Length

Value	Count	Frequency (%)
Individual(s)	125131	92.4%
Lender/REO	9380	6.9%
(Missing)	978	0.7%

Length

Max length	13
Median length	13
Mean length	12.72012488
Min length	3

SeniorHighSchoolName
Categorical

HIGH CORRELATION
MISSING

Distinct count	20
Unique (%)	< 0.1%
Missing	85203
Missing (%)	62.9%
Memory size	1.0 MiB

Plano Senior	19620
Planoeast	9819
Planowest	9285
Plano West	5424
Plano East	4246
Other values (15)	1892

Common Values
Length

Value	Count	Frequency (%)
Plano Senior	19620	14.5%
Planoeast	9819	7.2%
Planowest	9285	6.9%
Plano West	5424	4.0%
Plano East	4246	3.1%
Plano Sr	1710	1.3%
Centennial	72	0.1%
Frisco	65	< 0.1%
Plano	12	< 0.1%
Jasper	7	< 0.1%
Other values (10)	26	< 0.1%
(Missing)	85203	62.9%

Length

Max length	12
Median length	3
Mean length	5.718198525
Min length	3

SqFtTotal
Real number (ℝ_≥0)

Distinct count	5665
Unique (%)	4.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2623.4177239480696
Minimum	0.0
Maximum	17306.0
Zeros	36
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	1388
Q1	1892
median	2413
Q3	3186
95-th percentile	4406
Maximum	17306
Range	17306
Interquartile range (IQR)	1294

Descriptive statistics

Standard deviation	1019.39664
Coefficient of variation (CV)	0.3885757996
Kurtosis	5.883003564
Mean	2623.417724
Median Absolute Deviation (MAD)	611
Skewness	1.490959604
Sum	355444244
Variance	1039169.509

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1930	248	0.2%
2098	217	0.2%
1785	215	0.2%
1659	207	0.2%
1868	204	0.2%
1535	202	0.1%
2297	198	0.1%
1848	196	0.1%
1860	195	0.1%
2004	193	0.1%
Other values (5655)	133414	98.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	36	< 0.1%
49	1	< 0.1%
219	1	< 0.1%
520	1	< 0.1%
525	1	< 0.1%

Value	Count	Frequency (%)
17306	1	< 0.1%
15042	1	< 0.1%
15000	2	< 0.1%
14962	1	< 0.1%
14919	1	< 0.1%

StreetDirPrefix
Categorical

HIGH CORRELATION
MISSING

Distinct count	7
Unique (%)	0.2%
Missing	132091
Missing (%)	97.5%
Memory size	1.0 MiB

N	1038
W	971
S	830
E	545
NW	6
Other values (2)	8

Common Values
Length

Value	Count	Frequency (%)
N	1038	0.8%
W	971	0.7%
S	830	0.6%
E	545	0.4%
NW	6	< 0.1%
NE	5	< 0.1%
SW	3	< 0.1%
(Missing)	132091	97.5%

Length

Max length	3
Median length	3
Mean length	2.949944276
Min length	1

StreetDirSuffix
Categorical

HIGH CORRELATION
MISSING

Distinct count	8
Unique (%)	1.7%
Missing	135005
Missing (%)	99.6%
Memory size	1.0 MiB

N	159
S	143
W	103
E	73
NW	3
Other values (3)	3

Common Values
Length

Value	Count	Frequency (%)
N	159	0.1%
S	143	0.1%
W	103	0.1%
E	73	0.1%
NW	3	< 0.1%
SE	1	< 0.1%
NE	1	< 0.1%
SW	1	< 0.1%
(Missing)	135005	99.6%

Length

Max length	3
Median length	3
Mean length	2.992899793
Min length	1

StreetName
Categorical

HIGH CARDINALITY

Distinct count	15170
Unique (%)	11.2%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

Park	288
Virginia Hills	274
Preston	250
Cross Bend	221
Hickory	191
Other values (15165)	134265

Common Values
Length

Value	Count	Frequency (%)
Park	288	0.2%
Virginia Hills	274	0.2%
Preston	250	0.2%
Cross Bend	221	0.2%
Hickory	191	0.1%
Spring Creek	173	0.1%
14th	149	0.1%
Teakwood	146	0.1%
Mason	131	0.1%
Scenic Ranch	129	0.1%
Other values (15160)	133537	98.6%

Length

Max length	20
Median length	9
Mean length	8.909690086
Min length	1

StreetNumber
Categorical

HIGH CARDINALITY

Distinct count	10358
Unique (%)	7.6%
Missing	0
Missing (%)	0.0%
Memory size	1.0 MiB

2601	333
575	297
3801	284
3101	283
2204	267
Other values (10353)	134025

Common Values
Length

Value	Count	Frequency (%)
2601	333	0.2%
575	297	0.2%
3801	284	0.2%
3101	283	0.2%
2204	267	0.2%
2400	248	0.2%
8400	246	0.2%
2524	231	0.2%
2200	228	0.2%
2605	213	0.2%
Other values (10348)	132859	98.1%

Length

Max length	9
Median length	4
Mean length	3.991925544
Min length	1

StreetSuffix
Categorical

MISSING

Distinct count	44
Unique (%)	< 0.1%
Missing	13679
Missing (%)	10.1%
Memory size	1.0 MiB

Drive	65067
Lane	20289
Court	8613
Trail	5696
Street	4764
Other values (39)	17381

Common Values
Length

Value	Count	Frequency (%)
Drive	65067	48.0%
Lane	20289	15.0%
Court	8613	6.4%
Trail	5696	4.2%
Street	4764	3.5%
Road	4701	3.5%
Circle	3321	2.5%
Way	3302	2.4%
Place	1945	1.4%
Avenue	1264	0.9%
Other values (34)	2848	2.1%
(Missing)	13679	10.1%

Length

Max length	9
Median length	5
Mean length	4.671154116
Min length	3

ArchitecturalStyle
Categorical

HIGH CARDINALITY
MISSING

Distinct count	264
Unique (%)	0.2%
Missing	10981
Missing (%)	8.1%
Memory size	1.0 MiB

Traditional	113381
Ranch	2338
Contemporary/Modern	1804
Ranch, Traditional	1243
Mediterranean	753
Other values (259)	4989

Common Values
Length

Value	Count	Frequency (%)
Traditional	113381	83.7%
Ranch	2338	1.7%
Contemporary/Modern	1804	1.3%
Ranch, Traditional	1243	0.9%
Mediterranean	753	0.6%
Other	535	0.4%
Contemporary/Modern, Traditional	448	0.3%
French	289	0.2%
Craftsman	287	0.2%
French, Traditional	267	0.2%
Other values (254)	3163	2.3%
(Missing)	10981	8.1%

Length

Max length	98
Median length	11
Mean length	10.65966979
Min length	3

TaxLegalDescription
Categorical

HIGH CARDINALITY
MISSING

Distinct count	61974
Unique (%)	56.5%
Missing	25836
Missing (%)	19.1%
Memory size	1.0 MiB

SPRING CREEK PARKWAY ESTATES W	217
Spring Creek Parkway Estates W	137
WELLINGTON AT PRESTON MEADOWS	131
LAKES OF PRESTON VINEYARDS VIL	113
VILLAGES OF WHITE ROCK CREEK #	106
Other values (61969)	108949

Common Values
Length

Value	Count	Frequency (%)
SPRING CREEK PARKWAY ESTATES W	217	0.2%
Spring Creek Parkway Estates W	137	0.1%
WELLINGTON AT PRESTON MEADOWS	131	0.1%
LAKES OF PRESTON VINEYARDS VIL	113	0.1%
VILLAGES OF WHITE ROCK CREEK #	106	0.1%
Wellington At Preston Meadows	91	0.1%
VALOR POINTE - THE RESERVE AT WESTRIDGE PHASE	88	0.1%
Winsor Meadows At Westridge #0	87	0.1%
BILTMORE SWIM & RACQUET CLUB #	77	0.1%
PLANTATION RESORT AUGUSTA FARM	75	0.1%
Other values (61964)	108531	80.1%
(Missing)	25836	19.1%

Length

Max length	50
Median length	30
Mean length	27.53075895
Min length	1

YearBuilt
Real number (ℝ_≥0)

SKEWED

Distinct count	142
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1994.8067739816518
Minimum	0.0
Maximum	9999.0
Zeros	9
Zeros (%)	< 0.1%
Memory size	1.0 MiB

Quantile statistics

Minimum	0
5-th percentile	1972
Q1	1988
median	1997
Q3	2003
95-th percentile	2010
Maximum	9999
Range	9999
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	75.0504116
Coefficient of variation (CV)	0.03762289791
Kurtosis	10534.51134
Mean	1994.806774
Median Absolute Deviation (MAD)	7
Skewness	97.23247123
Sum	270274375
Variance	5632.564281

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2005	6410	4.7%
1998	6292	4.6%
2001	6195	4.6%
2000	6148	4.5%
1999	6072	4.5%
2006	5982	4.4%
2004	5951	4.4%
1997	5654	4.2%
2003	5334	3.9%
1996	5271	3.9%
Other values (132)	76180	56.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	9	< 0.1%
1857	3	< 0.1%
1860	2	< 0.1%
1876	2	< 0.1%
1877	1	< 0.1%

Value	Count	Frequency (%)
9999	11	< 0.1%
2020	1	< 0.1%
2019	11	< 0.1%
2018	55	< 0.1%
2017	190	0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	df_index	PostalCode	BathsTotal	BedsTotal	City	CloseDate	ClosePrice	CurrentPrice	DOM	ElementarySchoolName	HighSchoolName	AssociationType	ListPrice	LotSize	MiddleSchoolName	MLSNumber	NumberOfDiningAreas	NumberOfLivingAreas	NumberOfStories	Occupancy	OriginalListPrice	ParkingSpacesGarage	PoolYN	PropertySubType	RATIO_ClosePrice_By_ListPrice	RATIO_ClosePrice_By_OriginalListPrice	RATIO_CurrentPrice_By_SQFT	SchoolDistrict	SellerType	SeniorHighSchoolName	SqFtTotal	StreetDirPrefix	StreetDirSuffix	StreetName	StreetNumber	StreetSuffix	ArchitecturalStyle	TaxLegalDescription	YearBuilt
0	0	75071	1.0	2.0	McKinney	10/3/2014	150000.0	150000.0	1649.0	John A Baker	Prosper	None	230000.0	1 Acre to 2.99 Acres	Rogers	11363157.0	1.0	1.0	1.0	Owner	274900.0	2.0	False	RES-Farm/Ranch	0.65217	0.54565	151.82	Prosper ISD	Individual(s)	NaN	988.0	N	NaN	Custer	5841	Road	Early American	Abstract A0412 Horn, George, T	1930.0
1	1	75071	3.0	4.0	McKinney	10/3/2014	400000.0	400000.0	1649.0	John A Baker	Prosper	None	400000.0	3 Acres to 4.99 Acres	Rogers	11363138.0	2.0	2.0	1.0	Tenant	424900.0	2.0	False	RES-Single Family	1.00000	0.94140	152.09	Prosper ISD	Individual(s)	NaN	2630.0	NaN	NaN	Custer	5799	Road	Traditional	NaN	1965.0
2	2	75034	5.0	5.0	Frisco	7/29/2013	555000.0	555000.0	1324.0	Spears	Frisco	Mandatory	530200.0	Less Than .5 Acre (not Zero)	Hunt	11281961.0	2.0	3.0	2.0	Owner	800000.0	3.0	True	RES-Single Family	1.04677	0.69375	119.92	Frisco ISD	Individual(s)	NaN	4628.0	NaN	NaN	Lago Vista	5507	Lane	Traditional	Starwood #04 Village #15, Bloc	2004.0
3	3	75078	3.1	3.0	Prosper	10/17/2012	1490000.0	1490000.0	1243.0	Prosper	Prosper	None	1900000.0	10 Acres to 49.99 Acres	Prosper	11207426.0	2.0	3.0	2.0	NaN	2300000.0	3.0	False	RES-Farm/Ranch	0.78421	0.64783	322.93	Prosper ISD	Individual(s)	NaN	4614.0	E	NaN	Frontier	2380	Parkway	Victorian	W.T. Horn Survey, A-376	1990.0
4	7	75034	5.1	5.0	Frisco	12/19/2013	1138000.0	1138000.0	1091.0	Smith	Frisco	Mandatory	1190000.0	Less Than .5 Acre (not Zero)	Staley	11503844.0	2.0	3.0	2.0	NaN	1350000.0	3.0	True	RES-Single Family	0.95630	0.84296	217.05	Frisco ISD	Individual(s)	NaN	5243.0	NaN	NaN	Briarwood	3074	Lane	Traditional	NaN	2006.0
5	9	75093	5.2	6.0	Plano	6/28/2013	906500.0	906500.0	1066.0	Huffman	Shepton	Mandatory	998500.0	Less Than .5 Acre (not Zero)	Renner	11424721.0	2.0	3.0	2.0	Owner	1150000.0	4.0	True	RES-Single Family	0.90786	0.78826	148.97	Plano ISD	Individual(s)	Planowest	6085.0	NaN	NaN	Cliffview	1816	Drive	Contemporary/Modern	Cliffs Of Gleneagles, Blk A, L	1994.0
6	10	75075	2.1	3.0	Plano	3/17/2014	116994.0	116994.0	1047.0	Saigling	Vines	Mandatory	117000.0	Less Than .5 Acre (not Zero)	Haggard	11566790.0	1.0	2.0	2.0	Owner	137500.0	2.0	False	RES-Townhouse	0.99995	0.85087	66.40	Plano ISD	Individual(s)	Plano Senior	1762.0	NaN	NaN	Devonshire	3225	Drive	Contemporary/Modern, French, Traditional	Cobblestone Townhome Community	1987.0
7	16	75070	3.2	3.0	McKinney	12/21/2015	870000.0	870000.0	950.0	Comstock	Liberty	Mandatory	899000.0	Condo/Townhome Lot	Scoggins	11933761.0	2.0	2.0	2.0	Vacant	1045000.0	2.0	False	RES-Condo	0.96774	0.83254	203.99	Frisco ISD	Individual(s)	NaN	4265.0	NaN	NaN	Settlement	5724	Way	Traditional	RESIDENCES AT THE GRAND LODGE	2012.0
8	20	75078	2.1	3.0	Prosper	9/17/2014	535000.0	535000.0	883.0	Judy Rucker	Prosper	None	594900.0	10 Acres to 49.99 Acres	Reynolds	11756658.0	2.0	1.0	2.0	Owner	722775.0	2.0	False	RES-Single Family	0.89931	0.74020	248.84	Prosper ISD	Individual(s)	NaN	2150.0	W	W	Prosper	2076	Trail	Traditional	ABS A0147 COLLIN COUNTY SCHOOL	1987.0
9	23	75069	3.0	3.0	McKinney	12/18/2013	250000.0	250000.0	856.0	Malvern	Mckinney	Mandatory	269000.0	Less Than .5 Acre (not Zero)	Dr Jack Cockrill	11625707.0	2.0	2.0	2.0	Vacant	250000.0	2.0	False	RES-Single Family	0.92937	1.00000	99.88	McKinney ISD	Individual(s)	NaN	2503.0	NaN	NaN	Preservation	700	Lane	Traditional	Chapel Hill #01b, Blk C, Lot 1	2008.0

Last rows

	df_index	PostalCode	BathsTotal	BedsTotal	City	CloseDate	ClosePrice	CurrentPrice	DOM	ElementarySchoolName	HighSchoolName	AssociationType	ListPrice	LotSize	MiddleSchoolName	MLSNumber	NumberOfDiningAreas	NumberOfLivingAreas	NumberOfStories	Occupancy	OriginalListPrice	ParkingSpacesGarage	PoolYN	PropertySubType	RATIO_ClosePrice_By_ListPrice	RATIO_ClosePrice_By_OriginalListPrice	RATIO_CurrentPrice_By_SQFT	SchoolDistrict	SellerType	SeniorHighSchoolName	SqFtTotal	StreetDirPrefix	StreetDirSuffix	StreetName	StreetNumber	StreetSuffix	ArchitecturalStyle	TaxLegalDescription	YearBuilt
135479	213398	75070	3.1	4.0	McKinney	12/5/2014	264900.0	264900.0	NaN	Bennett	Mckinney Boyd	Mandatory	264900.0	Less Than .5 Acre (not Zero)	Dowell	13050048.0	2.0	3.0	2.0	Vacant	264900.0	2.0	False	RES-Single Family	1.00000	1.00000	86.57	McKinney ISD	Lender/REO	NaN	3060.0	NaN	NaN	Trinity	2401	Lane	NaN	FOUNTAINVIEW #3 (CMC), BLK E, LOT 39	2006.0
135480	213399	75070	3.1	4.0	McKinney	12/5/2014	264900.0	264900.0	NaN	Bennett	Mckinney Boyd	Mandatory	264900.0	Less Than .5 Acre (not Zero)	Dowell	13050048.0	2.0	3.0	2.0	Vacant	264900.0	2.0	False	RES-Single Family	1.00000	1.00000	86.57	McKinney ISD	Lender/REO	NaN	3060.0	NaN	NaN	Trinity	2401	Lane	NaN	FOUNTAINVIEW #3 (CMC), BLK E, LOT 39	2006.0
135481	213400	75071	2.0	4.0	McKinney	12/18/2014	199900.0	199900.0	NaN	Wilmeth	Mckinneyno	Mandatory	199900.0	Less Than .5 Acre (not Zero)	Dr Jack Cockrill	13056859.0	1.0	1.0	1.0	Owner	199900.0	2.0	False	RES-Single Family	1.00000	1.00000	107.24	McKinney ISD	Individual(s)	NaN	1864.0	NaN	NaN	Juno Springs	7720	Way	NaN	VIRGINIA PARKLANDS (CMC), BLK B, LOT 14	2005.0
135482	213401	75071	2.0	4.0	McKinney	12/18/2014	199900.0	199900.0	NaN	Wilmeth	Mckinneyno	Mandatory	199900.0	Less Than .5 Acre (not Zero)	Dr Jack Cockrill	13056859.0	1.0	1.0	1.0	Owner	199900.0	2.0	False	RES-Single Family	1.00000	1.00000	107.24	McKinney ISD	Individual(s)	NaN	1864.0	NaN	NaN	Juno Springs	7720	Way	NaN	VIRGINIA PARKLANDS (CMC), BLK B, LOT 14	2005.0
135483	213403	75075	2.0	4.0	Plano	8/21/2014	235000.0	235000.0	NaN	Davis	Vines	None	235000.0	Less Than .5 Acre (not Zero)	Haggard	13008187.0	2.0	1.0	1.0	NaN	235000.0	2.0	True	RES-Single Family	1.00000	1.00000	102.71	Plano ISD	Individual(s)	Plano Senior	2288.0	NaN	NaN	Cedar Elm	2625	Lane	NaN	TIMBERCREEK ESTATES (CPL), BLK F, LOT 29	1972.0
135484	213404	75078	3.0	5.0	Prosper	2/16/2015	327000.0	327000.0	NaN	Cynthia A Cockrell	Prosper	Mandatory	330000.0	Less Than .5 Acre (not Zero)	Rogers	13086217.0	2.0	3.0	2.0	NaN	330000.0	2.0	False	RES-Single Family	0.99091	0.99091	100.49	Prosper ISD	Individual(s)	NaN	3254.0	NaN	NaN	Crescent Valley	1440	Drive	NaN	CEDAR RIDGE ESTATES (CPR), BLK B, LOT 9	2011.0
135485	213405	75078	3.0	5.0	Prosper	2/16/2015	327000.0	327000.0	NaN	Cynthia A Cockrell	Prosper	Mandatory	330000.0	Less Than .5 Acre (not Zero)	Rogers	13086217.0	2.0	3.0	2.0	NaN	330000.0	2.0	False	RES-Single Family	0.99091	0.99091	100.49	Prosper ISD	Individual(s)	NaN	3254.0	NaN	NaN	Crescent Valley	1440	Drive	NaN	CEDAR RIDGE ESTATES (CPR), BLK B, LOT 9	2011.0
135486	213408	75093	2.0	4.0	Plano	3/19/2015	145000.0	145000.0	NaN	NaN	NaN	None	155000.0	Less Than .5 Acre (not Zero)	NaN	13107447.0	1.0	1.0	1.0	Owner	155000.0	2.0	False	RES-Single Family	0.93548	0.93548	79.32	Plano ISD	Individual(s)	NaN	1828.0	NaN	NaN	Birdsong	4400	Lane	NaN	PRESTON COVE (CPL), BLK D, LOT 1	1980.0
135487	213409	75093	2.0	4.0	Plano	3/19/2015	145000.0	145000.0	NaN	NaN	NaN	None	155000.0	Less Than .5 Acre (not Zero)	NaN	13107447.0	1.0	1.0	1.0	Owner	155000.0	2.0	False	RES-Single Family	0.93548	0.93548	79.32	Plano ISD	Individual(s)	NaN	1828.0	NaN	NaN	Birdsong	4400	Lane	NaN	PRESTON COVE (CPL), BLK D, LOT 1	1980.0
135488	213410	75093	2.0	3.0	Plano	10/30/2014	242500.0	242500.0	NaN	Barksdale	Shepton	Mandatory	259900.0	Less Than .5 Acre (not Zero)	Renner	13024976.0	1.0	1.0	1.0	Vacant	259900.0	2.0	False	RES-Single Family	0.93305	0.93305	131.87	Plano ISD	Individual(s)	Plano West	1839.0	W	NaN	Plano	5161	Parkway	Traditional	OLD SHEPARD PLACE #2 3 & 4 (CPL), BLK C, LOT 9	1985.0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows